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ABSTRACT 

A 1968 study by Justiz developed the first reliable 
measure of general teaching ability at the secondary level. This 

paper descr.ib.es the application of that measure to junior college 

instructors. When the teacher’s subject knowledge and his students’ 
ability levels are held constant, teaching ability may be measured by 
testing the students for the skills specified by the instructor's 
educational objectives. The procedure for conducting the study is 
presented in detailed form so that it may be utilized by researchers 
in other junior colleges. All test and questionnaire forms used in 
the study are reproduced. (MS) 
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IDENTIFYING THE EFFECTIVE INSTRUCTOR 

i* 

Introduction 

For 8 variety of reasons pedagogical skills have rarely been measured 
with any great degree of accuracy. At all levels of education, instructors 
are selected, employed, evaluated, and rewarded or dismissed without anyone 
really knowing how well they can teach. Some of the reasons for this failure 
to assess teaching have been reported in one Clearinghouse monographs 
others will be explored in forthcoming publications. 

If teaching is to be measured, adequate designs and procedures are 
needed. Professors John D. McNeil, W. J. Popham, and others in the UCLA 
Graduate School of Education have developed certain methods. The design re- 
ported here amplifies their work. 

This Topical Paper is the ninth in a series of research formats prepared 
and distributed by the ERIC Clearinghouse for Junior Colleges. Each paper 
can be used as the design for a study that can stand on its own or can be 
linked with other research efforts. We hope that the Topical Papers will 
stimulate much-needed research in the junior colleges. Investigators may re- 
ceive further information on this and other designs by writing to the Clearing 
house. 

Edward F. O'Connor, Jr. is President of the UCLA Graduate Student Associa 
tion and is currently writing his dissertation in Educational Statistics. 

Thomas B. Justiz received his doctorate degree at the UCLA Graduate 
School of Education and has written educational specifications for various 
public school systems. 

Arthur M. Cohen 
Principal Investigator 
ERIC Clearinghouse for 
Junior Colleges 



*Arthur M. Cohen and Florence B. Brawer, Measuring Faculty Performance , 
Washington; American Association of Junior Colleges, 1969. 



IDENTIFYING THE EFFECTIVE INSTRUCTOR 



The junior college instructor is often hired and evaluated on the basis 
of his in-depth knowledge of his subject field. Yet teaching requires more 
than subject knowledge. Somehow, this knowledge must be transmitted to, and 
incorporated by, the students. What skills and/or personality characteristics 
enable teachers to accomplish this task? Before we can answer this question, 
we must have a definition and a reliable measure of what we mean by trans- 
mitting knowledge. 

In a recent study at the secondary level, Justiz identified more and less 
effective student teachers on the basis of their ability to produce low-order 
problem-solving skills in their students in two different subjects.* To 
control for the teachers' subject knowledge, the researcher chose two fields 
with which the teachers were relatively unfamiliar. The study reported the 
first reliable differences between more and less competent teachers in the 
public schools and developed the first reliable measure of general teaching 
ability (GTA)- -defined as the teacher's ability to produce in his students 
the skills specified by his educational objectives. 

This Paper is concerned with application of the Justiz procedure to junior 
college instructors. For a more detailed explanation of the theoretical back- 
ground, refer to the dissertation already cited. 

Procedural Rationale 

If subject knowledge and general teaching ability combine to produce 

*Justiz, T.B, A Method for Identifying the Effective Teacher , Ed.D. 
dissertation, University of California, Los Angeles, August 1968. 



specific skills in the students, and if the teacher’s subject knowledge and 
his students’ ability levels can be held constant, then an instructor’s general 
teaching ability can be measured by testing his students for the skills spe- 
cified by the instructor’s educational objectives. This design focuses atten- 
tion on the ends of ins tract ion- -i.e. , student outcomes--on the rationale 
that Instructors cannot be evaluated in the absence of student achievement of 
specified outcomes. 

The instructor’s subject knowledge can be held constant by giving the 
instructor brief preparation in skills with which they are unfamiliar. Tfaeir 
task is to teach these skills to a class of students during a single class 
period. The instructors are ranked on the basis of their class s performance 
on tests given at the end of the class period. At least two different subjects, 
each taught to a different class, are required to insure that the rankings are 
reliable. The students must be randomly assigned to the special classes in 
order to insure that the classes are statistically equivalent at the beginning 
of instruction. 

The special classes must be limited to a single class period to avoid 
seriously dismpting the normal curriculum of the junior college. Because of 
this severe time limitation, the skills taught must be relatively simple. The 
authors do not wish to imply that teaching of simple skills is identical with 
the teaching of more complex skills (although we suspect that the correlation 
is rather high), nor that the teaching of skills is the sole function of 
schools or colleges. More abstract goals such as appreciation or attitude 
change can be appropriate where they can be specified in sufficient detail to 
allow the teacher and the evaluator to know when these goals are being achieved. 



4 



Procedure 

The following procedure is presented in "do-it-yourself" form so that 
researchers in several different junior colleges can perform the study with 
a minimum of difficulty.* 

A. Data Collection Procedures 

1. prepare a lesson kit in two or more different subject areas 
likely to be unfamiliar to your instructors. Each kit should 
specify the particular skill on which the students will be 
tested at the end of the instruction period. The difficulty 
level of the skill should be chosen so that approximately 
half the students will be reasonably proficient on the post- 
tests. In addition, the kit should include sufficient infor- 
mation to teach the skill to the instructor. The kit should 
also contain some material related to general topics but 
relevant to the specific objective. This is to insure that 
the instructor cannot use the kit to teach his class without 
a judicious selection of the appropriate materials. Appendix 
A and Appendix B present the two kits used in the Justiz 
study. These kits were validated for 11th- and 12th-grade 
students and may or may not be valid for junior college 
students. 

2. Prepare a post-test for each of the kits outlined in step 1. 

These post* tests should test the specific objective presented 
in the kit --no more and no less. Hie post-tests used in the 
Justiz study are presented in Appendices A and B. 

*Hie authors would appreciate hearing from anyone who conducts a study of 
this type. 
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3. Arrange to have ten or more instructors available to teach the 
subject you have chosen. The instructors must be available at 
the same time to allow for proper random assignment of the 
students, but the different lessons need not be taught on the 
same day. 

4. Arrange to have 15 to 30 students available for each instructor 
in the project. Devise a way to randomly assign the students 
to the different instructors. Either randomly re -assign the 

. ... V • »" f • 

’* - ..*»*• t : i.. 

students at the end of the first lesson, or randomly assign a 
fresh group of students to each instructor. The purpose of 
this second randomization is to insure that the sampling errors 
inherent in any randomization do not favor the same instructors 
for both sessions. One possible procedure is to choose a time 
for the study when most of the instructors involved have 
classes scheduled. r Jjie students can then be randomly assigned 
by having the instructors give each student a card telling him 
to go to another room where a different instructor will give 
him a lesson. At the end of the first lesson, the new instructor 
hands the student a second card giving him new instructions. 

5. Schedule a meeting with the instructors for the day before they 
are to present the lessons. Make sure at this meeting that 
none of the instructors is familiar with the general subject to 
be taught in the lessons. (For an example, see Form C-l in 
Appendix G.) Explain the project to the instructors and give 
them the kits and a set of general instructions (Form C-2). If 



the second lession is scheduled for a different day from the 
first lesson, give the second kit to the instructors 24 hours 
before the second lesson is scheduled. 

6. On the day of the lessons, make sure that the students are 
properly assigned and that the instructors teach for no more 
than the alloted time. When the time is up, give each in- 
structor enough post-tests for his class and a set of instruc- 
tions for administering them (C-3). 

7. Sometime before the instructors present their lessons, have 
the dear, of instruction or another appropriate administrator 
rank the instructors on their ability to teach (C-4). This 
will allow you to compare his rankings with those obtained 
empirically. 

8. You may wish to obtain other information from or about your 
instructor. Forms C-5 and C-6 are two possibilities. 

B. Data Analysis 

1. Compute the class means for each instructor for each lesson 
and enter the figures on Form C-7 in columns A and B. 

2. Rank the instructors according to their class performance on 
lesson one and lesson two and enter the figures in columns 

C and D. 

3. Record the dean's rankings in column E. 

4. Subtract column D from column C and enter the difference in 
column F. Repeat the process for C and E and for D and F; 
enter the results in columns G and H. 



5. Add columns F, G and H and enter the totals at the bottom. 

If the previous steps were performed correctly* all three 
sums should equal zero. 

6. Square the figures in columns F* G and and enter the 
results in columns 1* J and K. 

7. Add columns I, J and K and enter the totals at the bottom. 

8. Compute N(n 2-1) where N equals the number of instructors 
and enter the result on page 2 of G-7. 

9. Enter the sum totals for columns I* J and K in the desig- 
nated places and multiply by 6. 

10. Perform the indicated division by N(N^-1). 

11. The resulting three figures are the reliability coefficient 
and the correlations between the dean's rankings and the 
rankings on lesson one and lesson two. 
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Practice Exercise for Producing Student Achievement 
Using a Punched-card Computer Objective 



Instructions 



Prepare a 30~minute lesson for your students as follows: Read the- Objective 

and Related Subject Matter , and examine the Practice Exercises. Then prepare 
to teach the Objective in the manner in which you are most effective. You 
may select Practice Exercises from the following pages, or prepare your own, 
whichever you feel are most appropriate to the Objective . You can make notes 
on these assignment sheets if you wish. Please record the approximate time 
used for preparation of your lesson: . 

Objective 



Given: A punched card, and a diagram of computer cores on 

which the digits 0 to 9 are recorded: 

Students will be able to: Translate the digits 0 to 9 from the decimal number 

system, used with the punched card, to the binary 
number system, used with the computer cores (and 
vice versa). 

Related Subject Matter 



The punched card is now a common device for storing data and for transmitting 
data to a computer. High schools use punched cards as class cards at the be- 
ginning of each term. Telephone, gas, and oil companies bill their customers 
with them. 

Look at the sample punched card below. Each hole in a punched card represents 
one number to a computer. A computer cannot "read" numbers the way we do, but 
it can "read" holes in a punched card photoelectrically. 
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A standard convention is used for representing the numeric digits 0, 1, 2, 3, 

4, 5, 6, 7, 8, and 9 in a punched card. The punched card is arbitrarily 
divided into 80 vertical COLUMNS and 10 horizontal ROWS to represent the 
digits 0 to 9. COLUMNS are numbered from left to right, from 1 t:o 80 (at the 
bottom and near the top of the punched card). ROWS are numbered from top to 
bottom, from 0 to 9. 

As a card enters the computer, the computer "reads’ 1 the card, COLUMN by 
COLUMN until it comes to a hole. The distance from the LEFT EDGE of the card 
to the hole tells the computer which COLUMN the hole is in. The computer then 
measures the distance from the TOP EDGE of the card to the hole, to find out 
which ROW the hole is in. The numerical value of the hole is the ROW number. 

For example, in the sample punched card, a 1 is punched in COLUMN 2, a 4 is 
punched in COLUMN 5, and a 7 is punched in COLUMN 8. The higher values (7, 8 
or 9) are in the ROWS near the BOTTOM EDGE of the card. 

Notice that there is only one number punched in each column of the card. It 
is possible for only 80 digits to be stored in the card at one time. Only ten 
digits (0 to 9) have been stored in the sample punched cards. 

In order for a computer to "remember" the holes it has seen in the punched card, 
it must store each decimal digit, which the hole represents, inside the computer. 
Each decimal digit is recorded inside the computer using the binary number 
system. A set of only 4 binary computer cores is required to store all the 
digits from 0 to 9 as compared with 10 ROWS in the punched card. 
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Look at the 10 sets of 4 cores below. Each core is represented by a 
The cores are really ferromagnetic rings which can be turned "on" by electricity. 
When a core is turned "on" it looks like this (iy , when it is "off" it looks 
like this (o) . Different combinations of "on"and "off" cores can represent 
all the dechnal digits 0 to 9, as follows: In each set of 4 cores, the top 

core represents an 8 and the bottom core represents a 1. The two middle cores 
represent a 2 and a 4 respectively. The decimal digit 1, 2, 4 or 8 is repre- 
sented when one of these cores in a SET is turned "on." The numbers 3, 5, 6 
and 9 are represented when the two cores in a SET, which add up to these num- 
bers, are turned "on." The number 0 is represented when all cores are "off." 

The number 7 is represented when the 1, 2 and 4 cores are turned "on." Here is 
a summary of the 0 to 9 digits, represented by the magnetic computer cores: 



The digit 0 is represented when all cores are "off." 

The digit 1 is represented when the 1 core is "on. " 

The digit 2 is represented when the 2 core is "on." 

The digit 3 is represented when the 1 and 2 cores are "on." 

The digit 4 is represented when the 4 core is "on. " 

The digit 5 is represented when the 1 and 4 cores are "on." 

The digit 6 is represented when the 2 and 4 cores are "on. " 

The digit 7 is represented when the 1, 2 and 4 cores are "on. 
The digit 8 is represented when the 8 core is "on." 

The digit 9 is represented when the 1 and 8 cores are "on." 



Top Core = "8" when "on" 
= "4" when "on" 
= "2" when "on" 
Bottom Core = "1" when "on" 



The digit (0 to 9) represented 
in each column of the partial 
punched card at the right is 
shown in binary form by the core 
set directly above the card 
column. 



DIAGRAM OF COMPUTER CORES 
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Practice Exercises 
A. True or False: 

1. 80 sets of cores are required to store 80 columns of digits 

2. The computer knows which row it is reading by measuring the 
distance from the left-hand edge of the card to the row. 

3. A punched card can store a maximum of 80 numeric digits be- 
cause it has only 80 columns. 

4 . A 9 is the highest number that can be represented by a 
single set of 4 magnetic cores. 



B. Multiple Choice: 

1. 4 magnetic cores are equivalent to 

card. 



rows in a punched 



2, The largest number that the lower 3 cores will store 
is 



3. It would take 



cores to store 67 columns of digits. 



4. Hie largest number that 3 sets of cores could store 
is 



(T) 

(F) 

(T) 

(T) 



© 



2 3 8 5 
9 806 5 



67 670 76(268)l34 




999J 9 111 444 888 



D. 



Multiple Choice: 
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1. 


The portion of a punched card 

at the left has a digit 

punched in card column 6. 
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22|22222222 

333f33313)3 
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2. 


There are card columns in 

a punched card. 


40 


4 4 4 4f 4 44 4 4 * 


® 


3. 


There are numeric rows in 




55555 §5 5555 
6 6 6 6 b 6f fi 6 6 5 
77777770777 


® 


4. 


a punched card. 

The number represented by the 
set of magnetic cores at the 
left is . 


4 

5 


True or False: 









1. Each column in the card is equivalent to a set of 4 
magnetic cores. 

2. The computer knows which column it is reading by 
measuring the distance from the top edge of the 
punched card to the column. 

3. Cores can store any digit (from 0 to 9) that is 
punched in a card column. 

4. If 45 numeric digits we re punched in a card, it 
would require a total of 180 cores in the computer 
to store the 45 digits. 



2 3 4 (£) 6 



5©823 



(T) 

(F) 

(T) 

(T) 
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14 
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Hi 



E. Multiple Choice: 

Look at the punched card and the computer cores below: 

1. Core Set 1 represents the numeric digit in Card Column 

32 37 42 52 (62) 

2. Core Set 3 rejjj^sents the numeric digit in Card Column 

(J2) 42 32 52 47 

3. Core Set 4 represents the numeric digit in Card Column 

72 47 (32) 67 37 

4. Core Set 8 represents J*e numeric digit in Card Column 

32 37 (42) 47 57 

etc.t etc. 
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CORE SET NUMBER 
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F. Multiple Choice: 



1. A set of four magnet cores can store as many digits as 
can be stored in rows of a punched card. 

'TUT 2 3 1 5 



2 . 



It would take 
digits . 



sets of cores to store 43 columns of 



(43,) 2 14 172 178 256 



3. 



The bottom two cores will store any of the digits up 
to . 

9 8 O 6 5 



4. 72 cores could repres^pt card columns of digits. 



72 (18* 9 36 720 



G. Multiple Choice: 



1. The highest number that two sets of cores can store 
is . 

(99J 100 88 77 11 



2 . 



3. 

4. 



Ten rows in a punched card are the equivalent of __ 

10 8 6 @ 3 

The bottom core will store anv of the digits up to 

9 7 3 (p 0 

16 cores can represent card columns of digits. 

16 32 64 8 ® 



cores 
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NAME . AGE GRADE 

SCHOOL^ INSTRUCTOR 

Hiere are 10 card columns with numeric digits punched in them in the punched card 
below. For each of the 10 card columns , find the core set which represents the 
same numeric digit as the one contained in the card column, and answer the fol- 
lowing questions : 

1. Core Set Number 1 represents the digit in Card Column Number 

2. Card Column Number 77 represents the digit in Core Set Number 

3. Core Set Number 3 represents the digit in Card Column Number 

4. Card Column Number 57 represents the digit in Core Set Number 

5. Core Set Number 4 represents the digit in Card Column Number 

6. Card Column Number 32 represents the digit in Core Set Number 

7. Core Set Number 8 represents the digit in Card Column Number 

8. Card Column Number 62 represents the digit in Core Set Number _____ 

9. Core Set Number 9 represents the digit in Card Column Number 

10. Card Column Number 42 represents the digit in Core Set Number 
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Practice Exercise for Producing Student Achievement 
Using a News-Story Structure Objective 



Instructions 



Prepare a 30-minute lesson for your students as follows: Read the Objective and 

Related Subject Matter , and examine the Practice Exercises . Then prepare to 
teach the Objective in the manner in which you are most effective. You may 
select Practice Exercises from the following pages, or prepare your own, which- 
ever you feel are most appropriate to the Objective , You can make notes on 
these assignment sheets if you wish. Please record the approximate time used 
for preparation of your lesson: . 

Objective 

Given: Seven factual statements about a news-story; 

Students will be able to: Re-order the five most important statements in 

"inverted pyramid" form, so that the news-story 
appeals to a high school readership. 

Related Subject Matter 

The traditional form of news writing in the United States is called the "inverted 
pyramid." This means that the "most important" statement is written at the be- 
ginning of the news-story and that subsequent statements provide the reader con- 
venient exits of decreasing importance all the way to the end of the news-story. 
This form is in sharp contrast to other forms of written composition, such as 
essays or short stories, etc., where an author usually begins with incidental 
details and works to a climax near the end of the composition. The contempo- 
rary news writer first anticipates his reader's questions regarding the subject 
and then answers the questions in the order of their urgency. He first selects 
the climax, or most important fact, then fills in details with the second most 
important fact, the third most important, etc. For example, after a basketball 
game, what question would the high school reader be most likely to ask? 

What kind of game was it? 

What was the final score? 

Who won? 

The most urgent question would be who won the game, because neither the final 
score nor the kind of game it was would satisfy an average high school reader 
without first knowing who won the game. This is the natural way of telling a 
story. If someone drowns or there is a car accident, the average person would 
not begin by telling the events leading up to the incident; rather he would 
tell the important news first, and then relate the details of how and why. 

The reasons for the wide-spread adoption of the inverted pyramid are varied. 

Some say it had its origin in Civil War days when correspondents used the tele- 
graph for the first time. The war correspondents tried to crowd as much important 
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Information as possible into their first paragraphs for tear that the tele- 
graph line might be cut before completing the transmission. The system was 
perfected for the contemporary reader, who expects to get to the point of 
the news in a hurry. There are so many news items competing for attention 
nowadays that he hasn’t time to read much of the newspaper daily. (He is 
unlike the reader of 1690, who felt no compulsion to get to the point of the 
news in a hurry for there were fewer items competing for attention, and 
newspapers appeared only once a month.) Also, if the story is written in 
inverted pyramid form, the headline writer should not have to look beyond the 
first paragraph or two to find the words needed for the headline. 



Relevance and significance are implied when we say "importance' to the 
readers of the news-story, but deserve special mention here for clarity. Con 
sider the relevance and significance of the statements subsequent to who won 

the game: 



a chronological summary of the game 

the names of the officials 

the attendance 

the final score 

the high- scoring players 

The final score and then the high-scoring players would usually generate the 
most excitement during the game and the most discussion after the game. They 
are both relevant to who won and significant to the news-story. The chrono- 
logical sunsnary would then precede attendance and names of officials in order 
of importance. The attendance could be considered relevant to the game itself- 
but not to who won the game, and may be cut by the editor for lack of space. 

The names of officials, on the other hand, could conceivably be linked to who 
won in some stories involving disputes with officials, and would then be signif 
leant to news readers of those stories. To sum up this description, the 
inverted pyramid news-story should begin with a shout and end with a whisper, 
but the whisper should be both relevant and significant to the shout. 

Prac t ice Exercises 



A. Arrange the statements related to the "Lead" in their order of Importance 

to the news-story. 

Lead: Hie greatest marine disaster in the history of the world occurred 

last night, when the Titanic « the biggest and finest of steam- 
ships, shattered herself against an iceberg and sank in less 
than four hours. 

3 Every effort is being made to determine the names of the survivors. 

2 Most of the survivors are believed to be women and children. 

4 The survivors were picked up by the Cunarder Carpathla . 
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All night, a crowd of anxious relatives and friends of the 
passengers were massed in front of the Titanic's offices at 
Number 9 Broadway. 

1 Of the 2,200 passengers aboard, only 675 were saved. 

Re-arrange the facts below, in the order of most to least importance to a 

news -story. 

4 Watching his master walk to safety, Simon, his paws badly 
bleeding, resigned himself to wait for the stretcher. 

5 The sheriff and his deputies were (summoned by Donny 's 
father, Fred Brooks, when the pair were discovered missing. 

1 A ten-year-old boy and his 165-pound St. Bernard show dog 
got stuck on a Mt. Baldy ledge last night. 

2 Donny Brooks and his dog, Simon Bolivar, after walking up a 
1,000-foot hillside, became trapped on a ledge covered with 
loose shale. 

3 Little Donny was rescued as soon as the sheriff's men arrived, 
but Simon was carried to safety only after a three-hour battle. 

Re-order the 5 most important facts in the spaces provided, so that they 

will appear in the inverted pyramid form for readers of your news-story. 

Minutes of last Friday's meeting of the Los Angeles Chapter of the Data 

Processing Management Association contained the following items: 

3 Student affiliates are being encouraged by 110 of the 216 inter- 
national chapters. 

5 A manual is being developed by International Headquarters to 
assist the chapters in their forthcoming student membership 
drives. 

4 Student affiliates are already being sponsored by 14 local 
chapters --this allows a student to purchase all information 
from International Headquarters at: membership prices. 

The Long Beach Chapter is starting; to sponsor a student club, 

with the help of Tom Cashman. 

2 The proposal is for student membership at a reduced rate. 

1 A proposal for high school student; membership will be brought 
before the International Board of Directors at the June 
meeting. 
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D. Re-order the 5 most important facts in the spaces provided, so that they 
will appear in the inverted pyramid form for readers of your news-story. 



4 The victims were all scheduled to graduate with the summer class 
of 1968. 

2 The victims have been identified as Howard Horley of 621 Edmonston 
Road, Mary Smith of 7141 Park Avenue, and Sam Davidson of 111 
Holthead Drive. 

3 Horley was the driver of the car. 

1 Three Main High School students were killed instantly today when 
their light speedster hit an oncoming express train. 

5 ’'Howard was hurrying so that they would not be late for their 
fourth-period class,” his father said. 

A crack-down on all drivers of the speeds ter -type cars was 

promised by Police Chief Ed Sturgess. 

The car was reported as traveling greatly in excess of the speed 
limit . 

E. In the group below, identify the four statements you think are most important 

to the development of the ’’Lead” of the news -story. 

Lead: An incredible stock market tumbled toward chaos today, despite heroic 

measures by the nation's greatest bankers. 

1 Selling of stocks broke all previous records, reaching 16,410,030 
shares at the close. 

_____ Wall Street throbbed with excitement all day. 

______ It was a day of tremendous activity, with climaxes punctuating 

every hour. 

2 Losses of 30 points or more were incurred, threatening the credit 
structure of the country. 

The wolves raged through Wall Street all day. 

_____ The older traders ’’felt it in their bones” — the worst was over! 

3 Only an erratic rally in the last hour saved the market from 
utter chaos. 

4 Steel gave way to a $12.00 loss, but, true to its name, failed to 
crack and snapped back in the last minute. 
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F. Re-order the 5 most important facts in the spaces provided, so that they 

will appear in the inverted pyramid form for readers of your news -story. 

Place a U next to irrelevant items. 

Minutes of last Thursday’s meeting of the Los Angeles County Board of 

Supervisors contained the following items: 

U_ One of the members of the Board had to leave early after being 
told that his wife had been taken ill. 

2_ The Board voted unanimously that vacations at Green Lake Camp 
would be subsidized by the County for selected students. 

1 The Board voted 4-to-l to open the Green Lake Camp this summer 
for senior high school students. 

5_ Mr. B. Redding, Chairman, said that students needed more recrea- 
tion facilities. 

U The meeting started half an hour late. 

3 It was decided that underprivileged students, such as those with- 
out fathers, would be granted subsidies automatically. 

4 Hie Board’s Secretary said that seniors wanting subsidized vaca- 
tions must apply to their school principal before April 31. 



NAME 



SCHOOL 



AGE GRADE 



INSTRUCTOR 



You are a manager of a high school newspaper. Your only readers are high school 

students. Your writers have collected the facts below for two news -s tor ies . For 

each news -story below: 

1. Re-number the five most important facts in the spaces provided, so that 
they will appear in your news -story in the inverted pyramid form (from 1 
to 5). 

2. Identify two facts that are unimportant to the news -story by placing a U 
in the spaces provided. 

The Minutes of last Friday’s meeting of the Los Angeles Board of Education stated: 

1. Other budget cuts were in ground maintenance. 

2. The athletic budget was cut by $200,000 to eliminate post-season games. 

3. Only six of the seven Board members were present. 

4. The Board eliminated all budgeting for Open House Day. 

5. The Board abolished sixth-period classes, as part of a $300,000 budget cut. 

6. The meeting dragged on for over four hours. 

__ ___ 7. The Board considered hopes for restoration of the budget as dim. 

The Minutes of last Friday's meeting of the Los Angeles City Council stated: 

1. Councilman Van Horn demanded that school parking lots be converted into 

athletic fields whenever possible, to satisfy more of the needs of the 
community. 

2. The Council acted on receipt of police reports indicating that student 

parking on campus lots resulted in severe traffic congestion at five 
Los Angeles City schools. 

3. The minutes of the last meeting were approved with an unusual number of 

corrections. 

4. Three Council members voted against the resolution. 

5. One principal, Mr. E. B. Sloane, testified that his faculty and staff 

parking facilities were a little cramped. 

6. The meeting was held at City Hall. 

7. The Council, in resolution, urged the Los Angeles Board of Education to 

prohibit students from parking their automobiles on campus parking lots. 
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Form C-l 



Subject-Matter Familiarity Questionnaire 



Name_ 

1. What subject (s) do you currently teach? 

2. What subject (s) do you feel most comfortable teaching? 

3. Are you acquainted with any of the following subjects? 

Yes 

Accounting 
typewriting 
Shorthand 
Business Math 

Punched -Card or Computer Processing 

Business English 

Salesmanship 

Health Education 

Home Economics 

Journalism 

Nursing 

Police Science 
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Form C-2 

Practice Exercise to Aid in Producing Problem-Solving Skills 



Purpose { 

The purpose of this exercise is to give you practice in producing problem- 
solving skills as follows: 

1. You will be asked to teach to a specified problem-solving 
objective in a specified period of time. 

2. Student achievement of the specified objective is the only 
result expected, and you are free to use any method that will 
assist your students toward achieving the problem-solving 
objective. 

3. There will be no observers in your classroom while you are 
teaching. 

A. A paper and pencil post-test will be supplied for your use 
after the lesson. 

Materials : 

In this packet is a subject-matter "kit." (Your responses to the Subject-Matter 
Familiarity Questionnaire indicated that you were unfamiliar with the subject 
field.) Prepare a 30-minute lesson in the subject field overnight. You should 
be able to complete your preparation within an hour. 

Other Instructions : 

1. Time and place for the lesson 

2. Directions on the re-assignment of the students to rooms if the 
instructor will be asked to participate in this part of the 
project 

3. Other supplemental instructions, if any 
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Form 03 

Post -test Instructions 

Er ase the blackboard completely and distribute the post-tests from this packet. 
Write your name on the blackboard. Xnstruct students to fill in their name, 

age, school, grade, and your (instructor's) name. Be certain that each student 
has written his name on the post-test form. 

Read aloud to the class the instructions at the top of the form. Allow about 

fifteen minutes for them to take the test and then collect the post-tests. It 

is important that you allow each student to finish the test and that you collect 
them all. 

Place the post-tests, together with your subject-matter kit, in the packet. The 
packets will be collected. 
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Form C-4 



Dean's Rankings 

Please rank-order the instructors listed below from 1 to , according to your 

perception of their ability to develop problem-solving skills in their students. 



Rank 

Order Teacher Name 
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Form C-5 



Name 

Present position (title and institution) 

Years at this institution 

Experience (years taught at each type of institution) 

Elementary 

Secondary 

2 -year college 

4-year college 

Graduate course _____ 

Educational background: 

a. Institution Year(s) Major (s) Minor (s) Degree (s) 



b. Approximate number of courses (not units) taken after receiving 

bachelor's degree 

c. Approximate number of Education courses (include any taken as 
undergraduate) 






Form C-6 



Post-study Questionnaire 

Thank you again for your cooperation during the recent practice exercise. 

So that we may be able to improve future efforts of this kind, would you 
please relate some of your experiences during the exercise as follows: 



1 . Did you consider the exercise worthwhile? 

In what way? 

2. Were you short of time or resources during 
preparation or execution? 

In what way? 

3. Did you have any particular difficulties with 
the subject, other than possible lack of time 
or resources? 

In what way?__ 

4. Did you have any particular difficulties with 
any of your students? 

In what way? 

5. What did you like about the exercise? 



Yes No 



6. What did you dislike about the exercise? 



7. How do you feel your students performed in relation to the students in the 
other classes: 



Subject Subject 



Upper Quartile 
2nd Quartile 
3rd Quartile 
Lower Quartile 
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Form C-7 Calculation of 



[ 





eacher 



8 



10 



13 



14 



15 



Sum 

Total 



Lesson One 
Class Mean 



B 

Lesson Two 
Class Mean 



Lesson One 
Class Rank 



wesson TVo 
lass Rank 




E 

Dean ' s 
Ranking 
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Correlation Coefficients (Spear Rank-Order Coefficient) 
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F 

)ifference 
between Cols . 
C and D 


G 

Difference 
between Cols. 
C and E 


H 

Difference 
between Cols. 
D and E 


I 

Column F 
Squared 


J 

Column G 
Squared 


K 

Column H 
Squared 
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Form C-7 continued 



l 



N(N 2 -1) = 



where N equals the number of instructors 
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Reliability Coefficient for General Teaching Ability 

r » i - 6 times (sum total for column I) 

N(N 2 -1) 



r = 1 - ( 



Correlation between Dean's Rankings and Lesson One Rankings 
r * i . 6 times (sum total for column J) 

N(N 2 -1) 



r ■ 1 - ( 


) , 




( 


) 





Correlation between Dean's Rankings and Lesson TVo Rankings 

r s i m 6 times (sum total for column V) 

~ N(N 2 -1) 



r = 1 
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